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New Jersey has taXen steps to improve vocational 
education programs and services in response to two state reports and 
the measurement and evaluation requirements of the reauthorized Carl 
D. Perkins Vocational and Applied Technology Act of 1990 (P.L. 
101-392). Among state initiatives is the Occupational Competency 
Project, a study of loo occupations with high anticipated annual job 
openings, competency tests (performance standards) generated through 
this project will be the basis for the measurement of performance, 
and tests will be developed or identified to determine he; well 
vocational education projects are preparing individuals for 
employment. Federal guidelines for the development of such an 
accountability system are being incorporated into a state and local 
standards and measures system with the following components: (l) 
identification of measures (learning and labor market)? (2) 
development of lists of skills/competencies? (3) development of 
assessment strategies; (4) standard setting? (5) assessment of 
students? and (6) evaluation. An Occupation Competency Panel will 
prepare recommendations for the statewide occupational competency 
assessment program, one flowchart and an outline of potential 
measures and standards are included. An appendix contains a suggested 
management plan (including requirements under statutory authority, 
tasks, status, and timelines) for development of an evaluation system 
that meets the intent of the Perkins Act. (SLD) 
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INTRODUCTION 

In order 1 for the economy to remain strong, viable and Internationally 
competitive, the schools of this country oist train a competent and qualified 
workforce who can enter the world of work upon high school graduation with 
the skills, competencies and attitudes necessary to be successful. 
Vocational education has been the traditional vehicle for job training 1n 
this country. 

This roundtable discussion focuses on the New Jersey Department of 
Education's goal to Improve vocational education programs and services 
through a mandate for excellence. Occupational competency assessment was a 
logical outgrowth of the "Report of the Panel on Secondary Vocational 
Education In New Jersey" and "Accountability for Student Achievement— The 
Commissioner's Response to the Recommendations of the Panel on Secondary 
Vocational Education In New Jersey." These two reports coupled with 
measurement and evaluation requirements In the newly reauthorized Carl D. 
Perkins Vocational arj Applied Technology Education Act of 1990 CP.L. 
101-392) provided the framework' for continued accountability and program 
Improvement needs n vocational education. Then Commissioner of Education 
Saul Cooperman determined that: 

... If change to the (vocational) delivery system Is to occur, It will 
be brought about over time by job market demand and evaluation of 
program results. Modifications should be based on an evaluation of 
comprehensive, accurate data and each (vocational) delivery system 
should be measured by the same standards. In order to unify 
standards for all deliverers of vocational -technical education, a 
statewide system of accountability for student achievement 1s 
needed. 

OVERVIEW OF THE OCCUPATIONAL COMPETENCY PROJECT 

The State of New Jersey has taken the lead in establishing a statewide system 
of standards and measures of performance through the development of a job 
placement accountability system as well as an Occupational Competencies 
Project and assessment testing process. The Statewide Committee of 
Practitioners will review, comment on and propose revisions to a draft state 
proposal which the State Board of Education will develop to meet the 
requirements of Section 115 of the Perkins II legislation. 

With respect to the Occupational Competency Project, the staff began work by 
identifying 100 occupations to be studied. The occupations chosen were those 
with the highest anticipated annual job openings. During FY 1992, the 
project will contiiue the process of Identifying and verifying competencies 
for these occupations. Three of the five groups of 20 occupations will see 
activity. 



Thanks are expressed to two colleagues from the New Jersey State Department 
of Education, Carmela Joseph and Frederick L. Cappello, for their assistance 
In the development of the section on Standards and Measures. The work of the 
Occupational Competency Project Development Team as well as the Panel on 
Occupational Competency Assessment In New Jersey is gratefully acknowledged. 
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New Jersey's system of competency Identification and verification Is based on 
systems In use In a number of other states and the system used by stales 
belonging to the Vocational-Technical Consortium of States CV-TECS). The 
steps In the process are as follows: 

1. conduct research to Identify existing resources In each 
occupational areas; 

2. draft competency lists; 

3. hold technical committee (workers and direct supervisors) meetings 
to verify duties /tasks; 

4. hold educator panel (teachers from the occupational area) to verify 
duties and tasks and related academic skills; 

5. conduct mall surveys of employers to verify duties/tasks and to 
Identify entry-level tasks; 

t 

6. conduct mall surveys of educators to verify duties/tasks and 
related academic skills; 

7. develop occupational cluster matrices from completed listv, 

8. produce and disseminate final competency lists; and 

9. provide Implementation training. 

Each list developed through this process will Include related academic 
skills, both basic and advanced as well as entry-level and advanced job t*sks. 

The competency lists (performance ;tandards> generated by the activities 
described above will be the basis for measurement of performance. Tests will 
be Identified or developed to determine the extent to which vocational 
programs are providing the necessary Instruction and experiences to prepare 
individual: for employment. T he tests will contain measures of learning and 
competency gains for both work skill attainment/enhancement ar*d related 
academic skills EP.L. 101-293, s!14 (b) (1), s115 <B> (2) (B)3. 

The assessment will also include a review of placement Into additional 
training or education, pilitary service, or employment [sl?5 (b) (2) (D)3. 

OVERVIEW OF ISSUES RELATED TO STANDARDS AND MEASURES 

The evaluation accountability mandate in the reauthorized Perkins legislation 
chafes the state agency with the responsibility of developing and 
.mplementlng an accountability system that documents the overall progress of 
vocational education students and programs. 

In developing such a system, input, advice and technical counsel will be 
sought from a variety o<> entitles having responsibility for work force 
readiness in New Jersey The law requires that th.» state agency consult with 
Its Committee of Practitioners In the design and development of measu-es and 
standards. The state will also reach out to other participants in the 
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vocational enterprise Including the Mew Jersey State Employment and Training 
Commission. Of over-arching concern, will be the development of a perfor- 
mance system that Is credible and that reports and compares performance 
fairly. 

The National Center for Research In Vocational Education through the efforts 
of Gary Hoachlander as well as Information provided by the U.S. Department of 
Education teleconference on standards and measures have formed the nucleus of 
guidelines for the development of a successful accountability system. These 
guidelines are summarized below: 



I . Measures and Standards 

Measures of performance and standards are not synonymous. A 
performance measure Is a type of outcome deemed as an appropriate 
Indicator for accountability and could Include: student 
achievement test scores, program completion rates, competency gains 
and job placement rates. Performance standards on the other hand 
are levels of performance considered acceptable for particular 
measures. Examples include achievement test scores greater than 70 
percent, program completion rates higher than 75 percent, mastery 
of an additional 25 occupational competencies in each semester, a 
Job placement rate of 80 percent or higher. The determination of 
the degree to which a performance standard has been met, not met or 
exceeded relies on monitoring of the system. 

il. Types of Measures 

The legislation requires that states adopt one measure of learning 
and competency gains 1n academic skills and a measure of at least 
one of the following: competency attainment, job or work skill 
attainment, retention In school and placement. It should be noted 
that this 1s a minimum requirement and that the selection of more 
measures Is highly desirable. 

Measures of performance can reflect either learner outcomes or 
labor market outcomes. From a measurement point of view, 1t Is 
also Important to select some measures that can assess changes of 
performance over time. 

Standards should also be set that will allow for Interpretations of 
student growth and program success. Setting an absolute standard 
of expectancy of performance may In fact create a situation of 
admitting students to a program who are likely to do well and be 
successful . 

III. Determining Standards 

In the standards setting process, it Is Important to consider the 
following: 

• Examine "best practices" 1n terms of what other states and 
agencies have already adopted. 
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• Involve business and industry In the process and Identify what 
employers' expectations are tor entry-level employees. 

« Examine existing state standards which already may be In place 
for certain occupations which encompass either state licensure 
or certification. 

In many cases, the state can rely on data and Information for the 
accountability system that already exist and that are maintained by 
LEAs and postsecondary Institutions. 



IV. Parameters for the Accountability System: Who is accountable *or 
what? 

The reauthorized Perkins legislation does not speak to what level 
of performance needs to be monitored. Clearly, it would be of 
benefit to structure a system that reflects the many levels of 
performance to Include:- students, teachers, programs. Institutions 
and districts. For example, student performance might be assessed 
mainly In terms of achievement and competency gains while programs 
may be judged on completion rate and Institutions on dropout rates 
or high school graduation. 

Example of a tiered accountability system 

Student level Assessment In terms of achieve- 

ment and competency gains 

Program level Completion rate 

Institutional level Dropout rates or high school 

graduation 

V. Accountability Systems must be credible 

Any accountability system depends on a fair and accurate reporting 
and comparing of results. Normative comparisons need to be drawn. 
Accountability systems must incorporate statistical and 
methodological controls to ensure that appropriate comparisons are 
made and that appropriate Inferences about performance are drawn 
based on information which is Interpreted accurately and fairly. 

VI. Ccfliponents of a Good Accountability System 

• The measures and standards must be clearly defined. 

• The number of measures and standards should be manageable. 

• The data for measuring performance indicators, must be 
reasonably accurate, timely and easy to measure. 

• Measures and standards information must be provided regularly 
enough to make it useful. 
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STATE AW LOCAL STANDARDS AND MEASURES SYSTEM 



The schematic which follows outlines the 6 components of the State and Local 
Standards and Measures System. 

I. Identification of Measures (learning and labor market) 

The first phase forms the corner-stone of the system. During phase 
one all measures which will become part of the accountability 
system will be Identified. Doth learning (page 8) and labor market 
(page 9) measures will be Included. Consideration will also be 
given to the establishment of measures for special populations 
(page 10) cited In the law. 

If. Development of Skills/Competencies 

During this cycle, skills and competencies will be developed for a 
wide range of occupations. These competencies In addition to 
becoming a key component of the accountability system will also 
help schools develop or upgrade curricula to meet employers' 
standards. 



III. Development of Measures/Assessment Strategies 

This phase concentrates on the Identification/development of 
appropriate assessment strategies which can be used to gauge 
performance. 

IV. Setting Standards 

This phase concerns Itself with the setting of standards. In 
establishing standards (1) "best practices" will be reviewed; 
(2) Industry's input and employers' expectations for entry level 
employees will be sought; and, (3) existing standards and state 
licensure and certification requirements will be reviewed. 

V. Assessment of Students 



This phase deals with the actual implementation of the assessment 
at the various levels defined in the comprehensive accountability 
system. 



Vt. Evaluation 



This phase provides for the formative (process) and summatlve 
(product) monitoring of the implementation of the accountability 
system. Data gathered from the accountability system will be used 
by policy makers at various points in the feedback loop. 
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STATE AND LOCAL STANDARDS 
AND MEASURES SYSTEM 
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OUTLINE OF POTENTIAL MEASURES AND STANDARDS 

The outline on the following pages presents a listing of potential measures 
which could be considered In the development of the accountability system. 
Once the measures are agreed upon the standard setting process could begin. 

EXAMPLE: 

MEASURE STANDARD 

A. Academic achievement Ninety percent of students partlcl- 

Hlgh School graduation rate patlng In vocational education should 

graduate with their class. 

LEARNING MEASURE STANDARD 

A. Academic achievement 
academic achievement on 

standardized test 

1. Math 

2. Reading 

3. Writing 

4. Writing Sample 

5. Science 

B. Course completion rates 



C. High School graduation rates 



D. Degree or certificate 
completion rates 



E. Occupational competency measured 
by competency-based tests 



F. Other 



LABOR MARKET MEASURE 

A. Time needed to secure 
employment 



B. Rate of quarterly earnings 
Increase 



C. Entry-level wage/position 



D. Length of time employed In 
first Job 



E. Employer or employee 
satisfaction 



F. Quarterly earnings 



G. Placement rates 1n: 

1. Job-related training 



2. Any Job 



3. Further education 



4. The military 



H. 



Other 
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MEASURES FOR SPECIAL POPULATIONS STANDARDS 

A. Ratio of the percentage of 
students with special needs 
enrolled In selected vocational 
education programs to the percen- 
tage of students without special 
needs enrolled In selected 
vocational education programs. 



B. Ratio of the percentage of. 
students with special needs 
completing selected vocational 
education programs to the per- 
centage of students without 
special needs completing selected 
vocational education programs. 



C. Ratio of percentage of students 
with special needs entering jobs 
related to training to the per- 
centage of students without 
special needs entering jobs 
related to training. 



D. Other 



RECOMMENDATIONS OF THE OCCUPATIONAL COMPETENCY PANEL 

The New Jersey State Department of Education formed an occupational 
competency assessment panel which was charged with the responsibility of 
preparing recommendations for a statewide occupational competency assessment 
program which would include recommendations for the designing, selection, 
administration, and analysis of competency based assessment measures for 
vocational education programs in New Jersey. 

Recommendations for occupational assessment in New Jersey include: 

• Providing vocational education student outcome data that will be useful 
for program improvement; 

• Utilizing a criterion-referenced assessment model and including 
assessment of all work-related affective behaviors and performance 
skills and a sampling of cognitive occupational competencies; 
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Employing computer-assisted Hero banking to store, retrieve, and 
assemble the measurement Instruments to be used; 

Assessing cognitive and affective learnlr; by using Indirect objective 
rorngnltlon type Item until such time as 1t becomes economically and 
technologically feasible to use direct constructed-response Hems and 
Items appropriate for computerized adaptive testing; 

Assessing the attainment of performance skills by using "hands-on" 
direct assessments that are conducted by vocational teachers as an 
integral component of the Instructional program, verified by a 
third-party evaluation activity conducted at the end of the program, and 
supplemented with cognitive Indirect assessments of these skills; 

Administering assessments of cognitive growth during specified time 
periods just prior to program completion or high school graduation, but 
In time for students to receive from appropriate school personnel, 
personal feedback as to their performance, (e.g., 
exempl ary/acceptabl e/unacceptabl e ) ; 

Utilizing locally administered group paper-and-pencll and computerized 
tests of cognitive achievement that are In keeping with the state-of 
the-art and the resources available to develop. Implement, and maintain 
them; 

Using Instrumentation that Is based upon Incumbent-verified task 
analysis and adopted, adapted, or developed by paid review/writing teams 
who have appropriate experience and expertise In vocational teaching, 
the subject matter specialty, educational measurement, and business or 
Industry; 

Establishing policies and procedures for administering assessment 
Instruments at the local level (e.g., not assigning local personnel to 
proctor test of cognitive learning for students for whom they have 
provided instruction); 

Using assessment procedures and techniques presented 1n their individual 
educational plans (IEPs> when assessing the achievement of students with 
special needs and preparing separate summary reports for vocational 
students who have an IEP and those who do not; 

Utilizing appropriate criterion-referenced techniques for assessing the 
validity and reliability of tests and test Items used to assess 
cognitive growth; 

Setting performance standards for performance skills assessments at 
levels consistent with business and Industry expectations for 
entry-level workers and to ensure their validity and reliability, pilot 
testing performance skills assessment Instrument with incumbent workers 
and recent program graduates who are know to be competent. 

Adhering to the APA/AERA/NCME Standards for Educational and Pyschologial 
Testin g (1985) and including ongoing systematic efforts to a void test 



12 



BEST COPY AVAILABLE 



- 11 - 



bias generally and specifically, biases relating to limited English 

proficiency, computer-assisted testing, and group and cultural 
differences; 

• Contracting for the services of an outside evaluator to conduct 
continuous process and product focused evaluation activities which will 
provide data with regard to whether or not the competency assessment 
program meets Its own goals and objectives; and, 

• Considering establishing a third-party organization to administer the 
competency assessment with responsibility for developing. Implementing, 
and Improving the program. 

POLICY QUESTIONS 

In order to develop a comprehensive evaluation system certain policy 
questions need to be addressed. They are: 

• Hhat 1s meant by evaluation? There are a variety of definitions 
under the label EVALUATION. The Division of Vocational Education 
needs to agree on what Is meant by evaluation; the levels of 
evaluation; and, the need for evaluation. 

• Is the Division of Vocational Education required to evaluate all 
vocational programs, those funded with local funds as well as state 
and federal funds? 

• Can we evaluate programs using a SAMPLE or must we evaluate every 
program? 

• Adult vocational education programs, for the most part, do not 
result In job placement. Do we evaluate those programs labeled 
vocational but In reality are "hobby" courses, e.g. flower 
arranging, whltUng, etc.? 

• Do we evaluate career orientation and counseling programs that may 
or may not complement occupational programs? 
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MANAGEMENT PLAN 



The following pages Mgh'lght a suggested management plan for the development 
of a Comprehensive Evaluation system that meets the Intent of Perkins II, and 
also will provide a basis for future vocational education program planning 
and Implementation. 



CMK/cb: 1/79831 
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STATE RESPONSIBILITY: Section 115 - Stat© and Local Standards and HwwrM 



DRAFT 



Requirement* under Statutory 
Authority 



(8) GENERAL AUTHORITY - Each state 
board receiving funds under this Act 
shall develop and Implement a 
statewide system of Core Standards 
and measures of performance for 
secondary and post-secondary 
vocational education programs. 

The State Committee of Practitioners 
shall review, comment on and propose 
revisions to a draft state proposal 
... for a system of core standards 
and measures of performance for 
vocational programs by September 
1992. 



Task* 



Implement state and local standards 
and measures occupational 
competencies project. 



Develop the comprehensive system. 
The state and local standards and 
measures project Is only one aspect 
of the total system. 



Statua 



Timalfnme 



The development of the management 
plan for the project has been 
completed and Implenented. Not all 
of the 100 occupations have been 
addressed, however the process for 
competency verification Is In place, 

ISSUE: Not yet addressed by the 
project are those programs that are 
other than occupational. 



A plan Is being prepared by P&E 
staff to develop tha total systei 



On schedule 



Preliminary Plan for Asst. 
CoMiaeioaar'a review Oct* 4. 1191 ^ 
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STATE RESPONSIBILITY: Section 115 - 



Requirement* under Statutory 
Authority 



Tasks 



(b) REQUIREMENTS - Each system 
developed under subsection <a> shall 
Include: 

O) measures of learning and 
competency gains. Including 
student progress In the 
achievement of basic and more 
advanced academic sKIHs; 



Implement direct assessment of 
student achievement In the basic 
and wore advanced acad'i&lc sMUs 
for all vocational students both at 
the secondary and post-secondary 
levels. 
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Stats ard Local Standards and Hsaeur«a 



DRAFT 



Status Tlaallnes 



A raw nor* -Igorous Grids 11 High 
School Profit leny Ttst «HSPT> was 
administered In a trial for« In 
December of 1991. The new Grade 8 
Early Karnlng Test (EHT> hi given 
In April of 1991. 

Eleventh graders who took the HSPT 
In December do not have to pass the 
test In order to graduate. 
However, the results of this "due 
notice" administration will Nip 
the state determine how well the 
test measures the higher-level 
skills students will Beet to 
compete In an Increasingly 
competitive world, the state will 
administer the Grade 11 HSPT on a 
trail basis for the next two years. 

The grade 11 HSPT will become the 
official graduation e«am In 
December 1993- The first students 
who will be required to p»ss it ere 
students who graduate in June 1995 
(this year's eighth graders). 

The HSPT measures basic and higher 
order skill attainment In 
mathematics, reading, writing and 
I also Includes a writing sample. 




Requirement* undSr Statutory 
Authority 



STATE RESPOHSlBltITT: Suction 115 - 



Tasks 



(2> 1 or more measures of 
performance, which shall 
Include only: 

<A> competency attainment; 

(B) Job or *ork skill 
attainment or enhancement 
Including student progress 
In achieving occupational 
skills necessary to obtain 
employmant In the field 
for which the student has 
been prepared* Including 
occupational skills In the 
industry the student is 
preparing to enter; 

(C) retention in school 
or completion of secondary 
school or its equivalent; 
and 



Develop measures for learning 
outcomes to Include: 

• gains In academic 

achievement or 
occupational competencies 

• program completion rates 

• high school graduation 
rates 

• passing higher level math 
or science courses or 
advanced vocational 
courses 

• pursuit of further 
education or training 

• school or program 
attendance. 
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tats ami Local Standards and Nsasurss 



DRAFT 



St.tui Tlmallnse 



For secondary school student! . tht 
assessment strategy for all Intents 
and purposes Is In place; however 
basic and more advanced academic 
skill assessment must he eiamlned 
for those students enrolled In 
vocational programs at the 
post secondary level. 

The Occupational Competencies 
Project Is currently addressing 
several of the Indicators of 
performance In that each competency 
list Includes related academic 
skills In free enterprise/ 
entrepreneur ship, language arts, 
mathematics and science. Skills in 
occupational areas have been 
[ Identified to date but have not 
been matched to Individual . 
assessment tasks. 

Currently the Occupational 
1 Competencies Project has developed 
I lists of duties and tasks for 
occupations that will form the 
foundation of any assessment system 
I which will be state administered. 

I It is anticipated that much of this 
work will be undertaken through the 
consortium of states that belong to 
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STATE MSPOHSmun: Section t« - Stat, ana l»l Standard, and »•■«"•• 



DRAFT 



RooulrementTundar Statutory 
Authority 



Tasks 



Status 



Tlmsltms 



(D) placement Into 
additional training or 
education, military 
service, or employment; 



<3) incentives or adjustments 
that are: 

(A) designed to encourage 
service to targeted groups 
or special populations; and 

(B) for each student, 
consistent with the 
student's individualized 
education program 
developed under section 
614(a)(5) of the Education 
of the Handicapped Act. 
where appropriate; and 
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Develop measures for labor market 
outcomes to Include; 

• job placement (In related 
or unrelated Jobs) 

• earnings 

• time to employment 

• employer satisfaction 
Develop data colle:tlon system for: 

Handicapped Individuals 

• Academically disadvan- 
taged Individuals 

Limited English 
Proficient 

Actual or potential 
dropouts from secon- 
dary/post-secondary 

lnstltlons 

High school dropouts 

Members of economi- 
cally disadvantaged 
families 

Migrants 



V-TECS. 



In addition to the develop of a 
data collection system for all 
students enrolled In vocational 
programs Including those members « 
Special populations. It 
useful to develop measures such as. 

Ratio of the percentage of students 
with special needs enrolled in 
selected vocational education 
programs to the percentage or 
students without special needs 
enrolled In selected vocational 
education programs. 

Ratio of the percentage of students 
with special needs completing 
selected vocational education 
programs to the percentage of 
students without special needs 
completing selected vocational 
education programs. 
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STATE RESPONSIBILITY: Section 115 - S 



Tasks 



Displaced homemakers 

Individual* participate* 
!n programs not tradi- 
tionally taken by members 
of that sex 



RoouirflMnU under Statutory 
Authority 



• Individuals In correc- 
tional Institutions 



(4) procedures for using 
existing resources and methods 
developed In other programs 
receiving Federal assistance. 



Develop a coordination strategy to 
avoid duplication of effort and to 
maximize resources. 



24 



lata and Local Standards and Measures 



DRAFT 



Status 



Tlaatlnss 



Ratio of percentage of students 
with special needs entering Jobs 
related to training to tht - 
percentage of students without 
special needs entering Jobs related 
to training. 



The Occupational Competences 
Project has made eetensive use of 
existing resources and aethods. 
The process itself was deeetoped 
using Inforaatlon and materials 
from fourteen other states. 
Project staff and facilitators were 
trained in the process by Y-TECS 
staff and members at no cost to the 
state. 

Each draft competency list Is a 
compilation of lists froa those 
already In use in New Jersey 
districts, V-TECS products and 
lists developed by other sources. 
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STATE RESPONSIBILITY: Section 115 - St 



Requirements under Statutory 
Authority 



Tasks 



<c> COMSISTEMCY WITH OTHER 
PROGRAMS - In developing the 
standards and measures Included in a 
system developed under ^section 
(a), the state board shall take Into 
consideration: 

(1) standards and measures 
developed under Job oppor- 
tunities and basic skills 
training programs established 
and operated under a plan 
approved by the Secretary of 
Health and Human Services that 
meets the requirements of 
section 402(a>(19> of the 
Social Security Act; and 

(2> standards prescribed by 
the Secretary of Labor under 
section 106 of the Job Training 
Partnership Act. 



Develop draft lists of standards 
and measures cooperatively «ltn 
OOL, JTPA; and 

Develop draft lists of st* ndsrd * 
and measures cooperatively with the 
DOM, 



Identify appropriate {tprtstnUtlM 
to assist In the development of the 
total system, 

• SCOP - ad hoc committee 

• consultant group 

• Interagency coordination 

• other groups 
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and Local Standards and Measures 



DRAFT 



Status 

The state snd local standards and 
measures occupational competencies 
project has used JTPA mater 1 all In 
the development of draft lists. 

ISSUE: At this time the DOM has 
not been a part of the project. 



At the next SCOP meeting an ad hoc 
conmlttee nil I be appointed to 
address the total system during the 
developmental stages. Appropriate 
status reports ultl be mailed to 
the consultant. Interagency and 
other appropriate groups. 



Timet Inea 

January. 1991 



By Nov. I, 1991 



October 30, 1991 
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STATE RESPONSIBILITY: Section 115 - Stat, and Local Standards and Maasuras 



DRAFT 



Requirements under Statutory 
Authority 



(d) INFORMATION PROVIDED BT STATE 
BOARD 

(1) The Committee shall make 
recommendations to the State 
board with respect to modifying 
standards and measures to he 
used under this section, based 
on Information provided under 
paragraph (2). 

(2) To assist the Committee In 
formulating recommendations 
under paragraph <t>, the State 
board shall provide to the 
committee Information 
concerning differing types of 
standards and measurements. 
Indudlng— 

(A) the advantages and dts- 
advantages of each type of 
standard and measurement; 

(B) Instances In which such 
standards and measures 
have been effective; and 

(C) Instances In which such 
standards and measures 
have not been effective. 



MEASUREMENT: TYPE OF OUTCOME 




Develop measures for assessing 
program performance for secondary 
and post secondary that are: 

clear and concise 
reasonably accurate 
timely 

easy to measure 
easy to retrieve by 
schools 

compares performance 
more than 6. less than IZ 



ERIC 
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STATE RESPONSIBILITY: Section 115 - Stata and Local SiwUrdt an* Haasuraa 



DRAFT 



Requirements under Statutory 
Authority 



Tasks 



Status 



TlMtlfwa 



T 



Review and redefine current 
learning and labor market outcomes 
to Insure their ability to meet the 
needs of Perkins. S01CC and the 
SETC for example: 

a, program enrollment: 

schools and correctional 
facilities 

• number enrolled 

• percent male and 
female 

• percent enrolled 
non-tradltlonal 

• academic disadvantage 

• economic disadvantage 
LEP 

• race/ethnlclty 

• handicapped 

• single pregnant women 

• displaced home maker 
linkages to: 

co-op 
apprentice 
tech-prep 

b. program completer: 

schools and correctional 
facilities 

# number completed 

• percent special 
population 



Almost all or the date required Is 
currently collected with the 
exception of: 

Secc.tdar* 

'non-tradttlonal 
single pregnant women 
displaced hoe»m*kers 
linkages 



Adult 



non- traditional 
disadvantaged (academically 
& economically) 
LEP 

handicapped 
single pregnant women 
linkages 



ERJC 
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STMl RESPQHS I B I L 1 TT : Soctlon 115 - M»t« Lo"> M,Mur " 



DRAFT 



RequtraNnU under V-f >uttry 
Authority 



Tasks 



Status 



TtMllnss 



d- 
e. 



» percent male and 
female 

• percent non-trad!- 
t tonal 

academic corollaries 

• increased math ski Us 

• Increased science 
skills 

• attendance 

» school graduation 
rates 

• school dropout rates 

• acad/voc Integration 

occupational competencies 
program follow-up 

• earnings 
employer satisfaction 
employment tracking 
percent working/ 
related field 
percent working/ 
unrelated field 
percent continuing 
education 
percent military 
percent not employed 
percent seeking work 



• 



He will be requesting socUl security 
numbers to Unfc with M?e «». 
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STATE RESPONSIBILITY: Section 115 - Stats and Local Standard! and Naasuraa 



DRAFT 



Requirement* under Statutory 
Authority 



Teaks 



Status 



TImIIms 



STANDARD: LEVEL OF PERFORMANCE 

Develop qualitative and qualitative 
standards for programs regarding: 



philosophy /goals 
administration/supervision 
student population served 
financial Information 
Instructional program 
Instructional staff 
guidance 
support systems 
evaluation 

follow-up and linkages 



Develop performance standards for 
students for example: 

• standardized test scores 

• occupational competency 
gains 

Develop performance standards for 
programs for example: 

• completion & placement 
rats* 
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